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CLAIMS 



1 1 . A mobile deixis device comprising: 

2 (a) a camera to capture an image; 

3 (b) a wireless communication device, coupled to the camera and to a wireless network, to 

4 communicate the image with existing databases to find similar images; and 

5 (c) a processor, coupled to the wireless communication device, to process found database 

6 records related to similar images. 

1 2. The mobile deixis device as recited in Claim 1 comprising a display to view found database 

2 records and the found database records comprising web pages including images. 

1 3. The mobile deixis device as recited in Claim 1 comprising: 

2 (a) a storage medium coupled to the processor; and 

3 (b) a plurality of programs stored in the storage medium operative to interact with the 

4 processor and the wireless communication device to control the operation of the mobile deixis 

5 device, comprising: 

6 (i) a first program of the plurality of programs stored on the storage medium 

7 being operative to interact with the processor to capture the image from the camera; 

8 (ii) a second program of the plurality of programs stored on the storage medium 

9 being operative to interact with the processor to communicate with at least one database to find a 

10 similar image similar to the captured image; and 

1 1 (iii) a third program of the plurality of programs stored on the storage medium 

12 being operative to interact with the processor to provide to a display a plurality of similar images and 

13 maintaining an associated hyperlink for each similar image. 

1 4. The mobile deixis device as recited in Claim 3 wherein the second program of the plurality of 

2 programs stored on the storage medium further comprises a subprogram stored on the storage 

3 medium being operative to interact with the processor to communicate with at least one server 
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4 database to cause said server database to search further databases for a similar image similar to the 

5 captured image. 

1 5. The mobile deixis device as recited in Claim 1 comprising: 

2 (a) a storage medium coupled to the processor; and 

3 (b) a plurality of programs stored in the storage medium operative to interact with the 

4 processor and the wireless communication device to control the operation of the mobile deixis 

5 device, comprising: 

6 (i) a first program of the plurality of programs stored on the storage medium 

7 being operative to interact with the processor to capture the image from the camera; 

8 (ii) a second program of the plurality of programs stored on the storage medium 

9 being operative to interact with the processor to communicate with at least one computer having a 

10 database of images to cause the at least one computer to search the database of images to find a 

1 1 similar image similar to the captured image; and 

12 (iii) a third program of the plurality of programs stored on the storage medium 

13 being operative to interact with the processor to provide to a display of a plurality of similar images 

14 and maintaining an associated hyperlink for each similar image. 
15 

1 6. The mobile deixis device as recited in Claim 1 comprising: 

2 (a) a storage medium coupled to the processor; and 

3 (b) a plurality of programs stored in the storage medium operative to interact with the 

4 processor and the wireless communication device to control the operation of the mobile deixis 

5 device, comprising: 

6 (i) a first program of the plurality of programs stored on the storage medium 

7 being operative to interact with the processor to capture the image from the camera; 

8 (ii) a second program of the plurality of programs stored on the storage medium 

9 being operative to interact with the processor to communicate with at least one computer with web 
10 pages having images to search the images to find a similar image similar to the captured image; and 
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1 1 (iii) a third program of the plurality of programs stored on the storage medium 

12 being operative to interact with the processor to provide to a display of a plurality of similar images 

13 and maintaining an associated hyperlink for each similar image. 

1 7. The mobile deixis device as recited in Claim 3 wherein the at least one database includes a 

2 web site dispersed within the Internet and the plurality of programs stored in the storage medium 

3 further comprises: 

4 (i) a fourth program of the plurality of programs stored on the storage medium being 

5 operative to interact with the processor to identify any keywords linked to each similar image; and 

6 (ii) a fifth program of the plurality of programs stored on the storage medium being 

7 operative to interact with the processor to initiate a further search using the keywords to find 

8 additional similar images. 

1 8. The mobile deixis device as recited in Claim 3 further comprising: 

2 a global positioning system (GPS) receiver to identify the geographical location of the mobile 

3 deixis device; and 

4 wherein the plurality of programs stored in the storage medium operative to interact with the 

5 processor and the mobile communication device comprises: 

6 an additional program of the plurality of programs stored on the storage medium 

7 being operative to interact with the processor to eliminate any similar images that are known not to 

8 be located in the geographical location of the mobile deixis device. 

1 9. A system to provide location awareness services comprising: 

2 (a) a handheld device comprising: 

3 (i) a camera to capture an image of an location; 

4 (ii) a mobile communication device, coupled to the camera and to a wireless 

5 network, to communicate the image with existing computer files to find similar images; and 

6 (iii) a user interface, coupled to the mobile communication device, to 

7 communicate to an user any results of found similar images; and 

8 (b) a computer network including the wireless network and a wired network; 
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9 (c) a plurality of computers, each computer have a plurality of computer files and 

10 connected to the computer network, at least one of the computer files having an image similar to the 

1 1 captured image and when viewed includes associated text describing an object in the image. 

1 10. The system to provide location awareness services as recited in Claim 9 wherein the user 

2 interface comprises a display. 

1 11. The system to provide location awareness services as recited in Claim 9 wherein the user 

2 interface comprises a computer connection. 

1 12. The system to provide location awareness services as recited in Claim 9 wherein the 

2 associated text describes features of the object in the image including geographical location of the 

3 object. 

1 13. The system to provide location awareness services as recited in Claim 9 wherein the 

2 associated text describes features of the object in the image including a description and historical 

3 facts regarding the object. 

1 14. The system to provide location awareness services as recited in Claim 9 wherein the 

2 associated text includes a uniform resource locator (URL). 

1 15. The system to provide location awareness services as recited in Claim 9 wherein at least one 

2 of the computers includes a plurality of computer files having images of locations of interest located 

3 within a predetermined radius about a geographical location. 

1 16. The system to provide location awareness services as recited in Claim 15 wherein the 

2 computer having a plurality of computer files having images of objects of interest located within a 

3 predetermined radius about a geographical location was previously trained to find common objects 

4 known to be of interest. 
5 

5 




1 17. The system to provide location awareness services as recited in Claim 9 wherein at least one 

2 of the computers includes at least one computer file having an image of an object of known interest 

3 and an associated image of an object of less recognized interest within a predetermined radius about 

4 a geographical location of the known interest object to aid a user in finding the object of less 

5 recognized interest. 

1 18. The system to provide location awareness services as recited in Claim 9 wherein at least one 

2 of the computers includes at least one computer file having an image of an object of known interest 

3 and an associated image of an object of less recognized interest within the field of view of the known 

4 interest object to aid a user in finding the object of less recognized interest. 
5 

1 19. The system to provide location awareness services as recited in Claim 9 wherein at least one 

2 of the computers includes a capability to search other computers having at least one computer file 

3 having text matching the associated text describing the object in the an image. 

1 20. The system to provide location awareness services as recited in Claim 1 9 wherein at least one 

2 computer file having text matching the associated test describing the object in the image is 

3 communicated to the handheld device. 

1 21. The system to provide location awareness services as recited in Claim 1 9 wherein at least one 

2 computer file having text matching the associated test describing the object in the image is 

3 communicated to the computer that initiated the search. 

1 22. The system to provide location awareness services as recited in Claim 21 wherein the 

2 computer that initiated the search is capable of comparing the original image with images returned in 

3 the computer file having text matching the associated text describing the object in the image. 

1 23 . The system to provide location awareness services as recited in Claim 1 5 further comprising: 

2 a global positioning system (GPS) receiver to identify the geographical location of the mobile 

3 communication device to help eliminate non-useful images. 




1 24: The system to provide location awareness services as recited in Claim 1 9 wherein at least one 

2 of the computers includes at least one computer file having an image of an object of known interest 

3 and an associated image of an object of less recognized interest within the field of view of the known 

4 interest object to aid a user in finding the object of less recognized interest all located within a 

5 predetermined radius about a geographical location. 

1 25. A storage medium comprising: 

2 a first computer readable program code stored on the storage medium being operative to 

3 interact with a processor in a handheld device to capture an image from a camera; 

4 a second computer readable program code stored on the storage medium being operative to 

5 interact with the processor to communicate with multiple data files and to search said data files for a 

6 similar image similar to the captured image; and 

7 a third computer readable program code stored on the storage medium being operative to 

8 interact with the processor to provide to an user interface a plurality of similar images and 

9 maintaining an associated hyperlink for each similar image. 
10 

1 26. A method for identifying a location comprising the steps of: 

2 (i) providing a database of images, each image having an associated URL that includes 

3 said image and a description of the image; 

4 (ii) comparing an image of an unknown location with images from the database of images 

5 and providing a list of possible matching images; and 

6 (iii) reviewing the images in the list of possible matching images until the correct location 

7 is identified. 

1 27. The method for identifying a location as recited in Claim 26 wherein the comparing step 

2 includes comparing at least one of energy spectrum data, color histogram data, primitive filter data, 

3 and local invariant data. 
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28. The method for identifying a location as recited in claim 26 wherein the comparing step 
comprises at least one of the techniques including a least square matching technique, a normalizing 
the image technique, an eigen value technique, a matching histogram of image feature technique and 
an image matching engine with transformation technique. 



